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1.  Introduction.  Game  theory  is  a  collection  of  mathematical  models 
formulated  to  study  decision  making  in  situations  involving  conflict  and 
cooperation.  It  recognizes  that  conflict  arises  naturally  when  various 
participants  have  different  preferences,  and  that  such  problens  can  be 
studied  quantitatively  rather  than  as  a  mere  illness  or  abnormality  which 
should  be  cured  or  rectified.  Game  theory  attempts  to  abstract  out  those 
elements  which  are  common  and  essential  to  many  different  competitive  situ¬ 
ations  and  to  study  them  by  means  of  the  scientific  method.  It  is  concerned 
with  finding  optimal  solutions  or  stable  outcomes  when  various  decision  makers 
have  conflicting  objectives  in  mind.  The  game  model  describes  in  detail  the 
potential  payoffs  which  one  expects  to  occur,  and  it  points  out  how  one  should 
act  in  order  to  arrive  at  the  best  possible  outcome  in  light  of  the  options 
open  to  one's  opponents.  Game  theory  attempts  to  provide  a  normative  guide 
to  rational  behavior  when  in  a  group  whose  members  aim  for  different  goals. 
Although  there  is  much  interaction  between  the  areas,  one  frequently  disting¬ 
uishes  between  the  theory  of  games  (games  of  skill)  and  other  subjects  such 
as,  probability  and  statistics  (games  of  chance),  classical  decision  theory, 
utility  theory,  game  experiments,  and  gaming  or  simulation.  In  brief  a  game 
consists  of  players  who  must  choose  from  a  list  of  alternatives  which  will 
then  bring  about  expected  outcomes  over  which  the  participants  may  have 
different  preferences. 

It  is  clear  that  the  scope  of  game  theory  is  rather  broad  and  ambitious, 
and  that  the  analyst  must  restrict  himself  to  special  cases  if  he  hopes  to 
obtain  usable  results.  There  are  consequently  many  logical  classi f icat ions 
of  competitive  situations.  Some  of  the  ones  that  have  proved  helpful  to  the 
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Investigator  are;  the  number  of  participants,  the  number  of  moves  and  choices, 
the  constant-sum  and  general-sum  cases,  the  cooperative  and  noncooperative 
situations,  the  various  states  of  information  available  to  the  players,  and 
the  different  restrictions  which  may  be  placed  on  side  payments.  In  addition 
to  these  and  other  classifications,  most  game  theoretic  models  fall  into  one 
of  three  general  mathematical  formulations  or  some  natural  extension  of  them. 
These  formulations  are  called  the  extensive  form,  the  normal  form,  and  the 
characteristic  function  form;  and  they  are  described  in  some  detail  in  Sections 
3,  4,  and  5,  respectively.  The  object  of  this  paper  is  to  present  for  the 
nonspecialist  a  description  of  the  nature  of  these  three  basic  models,  a 
glimpse  at  some  of  the  known  mathematical  properties  of  these  models  and  their 
solution  concepts,  and  a  selective  mention  of  some  of  their  areas  of  applica¬ 
tions.  Some  technical  terms  will  be  used  without  definition  with  the  hope 
that  they  are  self-evident  or  have  sufficient  intuitive  meaning  so  as  to  be 
not  too  misleading.  Selective  references  are  given  throughout  for  the 
reader  who  wishes  to  further  pursue  these  topics. 

Although  some  game  theory  concepts  have  arisen  over  the  past  couple  of 
centuries,  modern  game  theory  dates  from  1944  with  the  publication  of  the 
monumental  work  Theory  of  Games  and  Economic  Behavior  [81]  by  von  Neumann 
and  Horgenstern  (vN-M) .  This  classic  book  describes  the  three  forms  men¬ 
tioned  above  and  it  extended  an  earlier  paper  by  von  Neumann  [78  :  pp.  13-42] 
which  appeared  in  1928.  Some  controversy  has  arisen,  however,  as  to  whom 
should  be  given  credit  for  the  origins  of  the  subject  (see  [41  :  p.  2]).  See 
[33]  for  a  survey  of  von  Neumann's  contributions  to  the  theory  of  games  and 
mathematical  economics.  A  history  of  game  theory  up  to  1944  is  being  prepared 
by  lorgenstern.  A  survey  of  the  modern  theory  until  1957  is  presented  in 
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Luce  and  Raiffa  [41],  and  the  text  by  Owen  [58]  describes  some  of  the  more 
recently  developed  models.  Several  of  the  major  mathematical  papers  in  the 
field  have  appeared  in  the  five  issues  of  the  Annals  of  Mathematics  Studies 
[14,36,31,32,78].  The  introductions  to  these  studies  also  provide  excellent 
survey  material  on  the  subject.  A  sign  that  game  theory  has  come  of  age  is 
the  publication  beginning  this  year  of  the  International  Journal  of  Game 
Theory  by  Physica-Verlag.  The  recently  published  Russian  edition  of  [81] 

has  a  survey  of  Soviet  work  in  the  field. 

2.  Applications.  Many  of  the  accomplishments  of  game  theory  are  of  a 
rather  general  or  conceptual  nature.  Its  ideas,  methodology  and  vocabulary 
have  become  part  of  the  daily  thinking  and  language  of  most  decision  makers 
as  well  as  many  others.  Its  concepts  arise  regularly  in  a  broad  spectrum  of 
activity:  in  government  conferences,  in  military  strategy  sessions,  in 
corporation  board  meetings,  in  some  of  the  new  educational  devices  in  the 
schools,  in  the  many  "adult"  games  which  have  recently  flooded  the  market, 
etc.  It  is  of  course,  difficult  now  to  determine  to  what  extent  these  changes 
were  influenced  by  the  mathematical  theory  of  games,  concurrent  analytical 
approaches,  to  less  quantitative  methods,  or  to  many  other  parallel 
developments.  However,  it  is  certainly  clear  that  there  has  been  a  rather 
profound  change  in  the  way  many  people  think  about  competitive  situations, 
and  it  is  likely  that  many  of  these  advances  owe  a  great  deal  to  the  formula¬ 
tion  of  the  theory  of  games,  even  though  many  of  these  are  now  taken  for 
granted.  Many  of  the  advances  have  come  about  due  to  the  introduction  of  the 
srientlfie  method  to  analyze  problems  that  originate  in  the  social  area. 

There  are  certain  efficiencies  and  insights  gained  by  abstracting,  general iz 
ing,  folgettlng  Hi  f  .  n*-  r  L«>  aenign  qn  i  t  r>«-  I  v«"  n**rtsntes  tO 
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concepts,  and  clarifying  what  is  common  to  a  large  number  of  different  prob¬ 
lems.  This  often  illuminates  the  nature  of  the  problem,  leads  to  the  grasping 
of  its  essential  elements,  and  helps  to  pinpoint  the  difficulties  involved. 
Some  of  the  ideas  suggested  by  game  theory  are  rather  obvious;  for  example, 
listing  all  of  your  alternatives  and  likely  outcomes  rather  than  just  compar¬ 
ing  a  few  of  the  traditional  cr  more  obvious  ones,  or  placing  yourself  in 
the  position  of  your  opponent  and  considering  all  of  his  possibilities  rather 
than  just  his  past  policies.  Just  the  formulation  and  understanding  of  the 
game  to  this  extent  is  often  a  partial  solution  to  a  problem.  As  obvious  as 
these  ideas  are  there  is  some  experimental  evidence  to  indicate  that  people 
do  not  always  do  this.  (There  are  still  many  decision  makers  like  the  old 
authoritarian  surgeon  who  recognizes  (or  at  least  tells  you)  only  three  prob¬ 
abilities  of  a  successful  outcome  depending  on  which  operation  is  being 
contemplated:  1  -  e,  1/2,  and  c  where  e  is  some  small  nonnegative  number 
but  fixed.)  Other  contributions  often  attributed  to  game  theory  are  perhaps 
less  obvious;  for  example,  assigning  quantitative  measures  to  the  expected 
gains  obtained  from  threats  and  bluffing,  the  clarification  of  when  secrecy 
is  essential  and  the  potential  benefits  from  spying,  and  the  need  for 
unpredicabillty  as  given  by  a  "mixed"  strategy.  Even  poor  Charlie  Brown  in 
the  comic  strip  of  today  knows  the  futility  of  the  cyclic  reasoning  involved 
in  trying  to  decide  how  to  out-fox  the  hitter,  that  is,  whether  to  pitch  a 
fast  ball  or  a  slow  curve.  Contrast  this  to  the  decision  rule  used  by  the 
school  boy  described  by  Edgar  Allan  Poe  who  supposedly  won  all  the  marbles 
in  the  "even-odd"  matching  game  [12  :  p.  26).  These  formerly  vague  concepts 
can  be  made  much  more  precise  today,  and  one  can  often  actually  compute  the 
optimal  frequencies  with  which  he  should  bluff,  mix  his  choices,  etc.  Just 
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the  formal  definition  of  a  "nonzero-sum''  game  may  have  brought  home  to  some 
people  the  simple  fact  that  every  loss  to  your  enemy  need  not  be  a  gain  for 
yourself,  which  contrasts  with  the  "zero-sum  thinking"  we  observe  so  often 
concerning  opposing  forces  in  the  international  political  scene.  It  is  true 
that  many  of  these  conceits  made  precise  in  game  theory  were  not  all  new  at 
the  time  and  appear  as  rather  straightforward  today,  and  consequently  some 
tend  to  downplay  the  contributions  of  the  originators  of  the  subject. 
Nevertheless,  many  of  these  have  only  become  "obvious"  after  the  fact.  More¬ 
over,  there  is  a  certain  trivialization  of  knowledge  which  often  takes  place 
over  time.  It  is  difficult  to  assess,  for  example,  the  influence  of  the 
developments  of  calculus  in  areas  beyond  its  immediate  impact  on  mathematics 
and  physics.  There  is  evidence  that  the  game  theory  of  the  past  quarter 
century  or  so  has  had  a  profound  effect  on  the  way  we  view  problems  and  make 
decisions.  However,  it  is  not  unlikely  that  some  of  the  current  research  in 
the  area  will  have  similar  payoff  in  the  future. 

There  have  been  a  large  number  of  concrete  applications  of  .ime  theory 
to  many  different  fields,  including  economic  theory  and  application,  opera¬ 
tions  research,  business,  management  science,  political  theory,  military 
science,  education,  sociology  and  psychology.  There  are  hundreds  of  papers 
detailing  these  various  uses  of  the  game  models,  and  any  attempt  to  survey 
these  or  to  compose  a  fairly  complete  bibliography  on  them  would  be  very 
time-consuming  and  extremely  lengthy.  A  small  fraction  of  the  areas  of 
applicability  are,  however,  mentioned  in  the  succeeding  sections  after  a 
general  discussion  of  the  particular  game  models.  The  Selected  RAND  Abstracts 
and  the  Index  of  Selected  Publications  of  The  RAND  Corporation  alone  lists 
over  400  papers  in  the  game  theory  area  proper,  and  a  good  fraction  of  these 
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are  relevant  to  applications.  Presumably  RAND  has  put  out  many  other  papers 
in  this  area  which  were  for  internal  or  limited  distribution  or  were  classi¬ 
fied,  and  several  of  its  other  contributions  made  use  of  this  theory.  Many 
of  these  applications  of  game  theory  have  influenced  major  decisions  in 
management  in  several  fields  and  at  all  levels.  In  a  recent  and  very  excel¬ 
lent  text  {82  :  pp.  x,  xiii,  161-162]  on  operations  research  containing  over 
1000  pages,  the  author  has  chosen  to  relegate  game  theory  to  one  long  exercise 
following  linear  programming  which  outlines  the  zero-sum  matrix  games.  In  his 
preface  he  makes  the  following  statement  which  is  similar  to  remarks  made  by 
others  before  him.  "In  practicing  operations  research,  we  have  found  that 
game  theory  does  not  contribute  any  managerial  insights  to  real  competitive 
and  cooperative  decision-making  behavior  that  are  not  already  familiar  to 
church-going  poker  players  who  regularly  read  the  Wall  Street  Journal."  I 
agree  that  it  is  highly  desirable  to  not  add  another  brief  chapter  to  the 
several  dozen  now  in  existence  in  texts  in  several  different  subjects  which 
cover  this  very  specialized  topic  in  game  theory.  On  the  other  hand,  I 
heartily  disagree  with  the  implication  that  new  contributions  of  a  nontrans¬ 
parent  nature  are  not  made  regularly  today  by  means  of  game  theoretical 
analysis.  In  two  and  one-half  years  at  The  RAND  Corporation  where  I  was  one 
of  more  than  a  dozen  game  theorists,  I  was  consulted  a  couple  of  times  each 
month  about  an  Important  nonobvious  real-world  problem  for  which  the  game 
approach  was  the  most  appropriate  analytical  tool.  In  a  significant  percent 
of  these  cases  insights  or  solutions  could  be  obtained  or  at  least  approxi¬ 
mated.  The  results  of  this  type  have  certainly  been  of  much  interest  to  many 
managers  and  decision  makers.  Another  view  of  how  top  corporate  managers 
view  many  of  their  decisions  in  a  game  context  and  how  they  see  the  rules  of 


the  game  changing  in  today’s  world  is  given  in  a  series  of  articles  in 
Fortune  magazine  over  the  past  couple  of  years  written  by  John  McDonald. 
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McDonald's  earlier  book  [50]  is  still  an  enjoyable  and  very  readable  intro¬ 
duction  to  the  topic  for  the  layman.  Perhaps  some  of  the  extreme  and 
diverse  views  on  the  applicability  of  game  theory  heard  currently  are 
brought  about  by  the  great  fluctuation  in  the  expectations  of  this  subject 
over  the  years.  Shortly  after  the  appearance  of  Theory  of  Games  and  Economic 
Behavior  the  expectations  for  this  subject  skyrocketed  to  great  heights  as 
can  be  seen  from  some  of  the  reviews  for  this  book  written  in  that  period; 
for  example,  see  [10].  Even  before  its  publication,  there  was  some  consider¬ 
ation  given  to  classifying  this  book,  because  of  the  valuable  and  potentially 
useful  information  it  would  give  the  enemy.  These  expectations  plummeted 
back  down  after  a  few  years  because  it  became  clear  to  some  that  many  diffi¬ 
culties  existed  and  that  solution  concepts  for  the  more  general  games  were 
not  as  sharp  or  precise  as  one  may  have  hoped  for.  In  short,  the  overly 
ambitious  projections  were  followed  by  a  deep  disillusionment.  There  is 
good  evidence,  however,  that  expectations  have  been  on  the  rise,  though 
with  a  smaller  rate  of  increase,  for  the  last  decade.  When  one  hears  praise 
or  criticism  of  game  theory  he  should  check  into  which  of  these  periods  gave 
rise  to  these  opinions  and  whether  they  are  still  valid. 

There  are  many  substantial  difficulties,  unsolved  problems,  and  valid 
criticisms  of  game  theory.  On  the  other  hand,  one  often  hears  many  super¬ 
ficial  or  unjustified  criticismsof  the  subject,  as  well  as  some  which  now 
are  of  historical  interest  only.  There  is  also  an  impatience  with  the  lack 
of  the  theory's  use  in  making  predictions  in  the  real-world,  but  it  is  not 
clear  that  these  are  so  few  in  comparison  with  some  other  popular  analytical 
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approaches  in  light  of  the  shortagg  of  broadly  trained  experts  in  the  area. 

It  is  quite  clear  that  many  important  competitive  situations  are  covered 
inadequately  or  not  at  all  by  current  theory,  and  there  is  much  need  for 
extension  of  know  methods  as  well  as  for  the  introduction  of  additional 
models.  It  is  preferable,  however,  that  the  researchers  in  these  new  areas 
be  thoroughly  familiar  with  the  capabilities  and  limitations  of  existing 
knowledge,  as  apparently  has  not  always  been  the  case.  The  theoretical 
development  of  games  has  been  hindered  by  the  inherent  mathematical  diffi¬ 
culties  of  the  subject.  The  field  has  suffered  because  of  the  small  amount 
of  close  contact  between  game  theorists  and  pure  mathematicians  in  recent 
years,  despite  the  fact  that  many  of  the  originating  groups  and  a  couple  of 
the  current  centers  are  in  mathematics  departments.  Imagine  what  would  be 
the  position  and  impact  of  game  theory  and  other  modem  techniques  in  the 
social  sciences,  if  they  had  received  as  much  attention  from  high  quality 
quantitative  analysts  and  experimentalists  over  as  long  a  period  of  time  as 
has  been  the  case  in  much  of  the  physical  sciences.  It  is  unlikely  that 
progress  would  be  anywhere  as  slow  as  it  has  been,  in  say,  differential 
games,  if  this  topic  got  as  much  attention  as  the  theory  of  differential 
equations.  On  the  other  hand,  the  behavioral  sciences  are  hardly  as  simple 
in  some  ways  as  the  physical  sciences;  for  example,  in  the  number  and  scope 
of  the  basic  principles  or  laws  involved.  What  game  theory  has  to  offer  to 
understanding  in  social  sciences  has  not  been  widely  appreciated,  and  the 
professional  game  theorists  are  often  guilty  of  not  communicating  potential 
applications  of  existing  theory,  in  particular  the  more  recent  results. 

There  is  evidence  that  specialists  in  some  fields  are  completely  unaware  of 
potential  benefits,  whereas  those  in  other  areas  have  some  knowledge  but  lack 
the  mathematical  background  or  incentive  to  pursue  these  possibilities. 
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Modern  game  cheory  is  a  rather  young  science.  It  has  been  on  the  scene 
for  just  over  a  quarter  of  a  century,  and  it  is  still  in  a  state  of  active 
development.  It  has  already  become  a  standard  tool  for  many  investigators 
in  several  areas.  Its  broad  scope  is  evidenced  by  the  large  number  of  dif¬ 
ferent  university  departments  which  employ  its  users  and  teach  courses  on 
it,  ac-  well  as  by  the  variety  of  texts  which  present  some  of  its  concepts. 
Came  theory  is  the  only  quantitative  approach  so  far  for  analyzing  certain 
types  of  problems.  Although  its  proponents  may  have  made  overly  ambitious 
projections  for  it  initially,  it  is  highly  unlikely  that  we  will  return  to 
a  less  mathematical  approach  to  these  problems  in  future  studies.  Even 
though  most  of  the  applications  to  date  have  been  rather  elementary,  there 
is  a  great  deal  of  additional  theory  around  which  should  prove  beneficial 
in  many  areas.  In  fact,  theory  has  recently  been  outdistancing  applications. 

We  close  this  discussion  of  the  applicability  of  game  theory  with  the 
opening  passage  from  the  recent  book  Knots  (Pantheon  Books)  by  R.D.  Laing. 

They  are  playing  a  game.  They 
are  playing  at  not 
playing  a  game.  If  I  shrw  them 
I  see  they  are,  I 
shall  break  the  rules  and  they 
will  punish  me. 

I  must  play  their  game,  of  not 


seeing  I  see  the.  game. 


10 


3.  Tilt?  Tree.  The  first  detailed  description  of  a  game  in  exten¬ 

sive  form  was  presented  by  vN-M  [81  :  Chapter  2)  in  terms  of  set  theoretic 
concepts.  A  slightly  different  and  more  geometric  definition  due  to  Kuhn 
[ 28 ;  32  :  pp.  193-216]  is  usually  employed  today,  and  is  presented  here  in  a 
somewhat  intuitive  manner.  For  a  more  detailed  discussion  and  some  simple 
examples  consult  [41  :  Chapters  3  and  7]  and  the  following  paper  by  Aumann 
and  Maschler. 

A  general  n-person  game  In  extensive  form  is  a  topological  tree  (a 
finite  connected  graph  with  no  cycles  and  with  no  vertices  of  degree  two) 
with  the  following  specifications.  There  is  one  distinguished  vertex  cor¬ 
responding  to  the  starting  point.  Each  nonterminal  vertex  is  a  choice  point 
and  is  labeled  with  one  of  the  n  players  1,  2,  . ...  n;  or  by  the  "chance 
player"  denoted  by  0.  Each  edge  "leading  out"  of  a  vertex  describes  a 
possible  move  by  the  corresponding  player  if  this  point  in  the  game  is 
reached.  Each  vertex  labeled  by  0  has  a  probability  distribution  over  its 
moves.  To  each  terminal  vertex  there  is  assigned  an  n-dimensional  payoff 
vector  whose  components  describe  the  outcomes  to  the  respective  players  when 
the  game  ends  there.  The  set  of  all  vertices  for  a  particular  player  i  is 
partitioned  into  information  sets.  When  it  is  one  of  his  turns  to  make  a 
choice,  i  is  aware  of  the  information  set  he  is  in,  but  he  does  not  know 
the  precise  vertex  within  this  set.  For  each  vertex  in  a  given  information 
set  there  is  the  same  number  of  potential  moves,  and  one  normally  assumes 
that  in  playing  a  game  no  such  vertex  can  come  "after"  another  one  in  the 
same  information  set. 

When  engaged  in  a  particular  game  each  player  is  faced  with  the  problem 


of  how  to  best  play  the  game  in  order  to  maximize  his  expected  payoff.  A 


player's  complete  plan  for  playing  a  game  is  called  a  strategy t  of  which 
,  there  are  several  different  types.  A  pure  strategy  for  player  i  is  a  rule 
for  picking  a  particular  move  at  each  of  his  information  sets.  A  mixed 
strategy  for  i  is  a  global  randomization  over  his  pures,  that  is,  a  prob¬ 
ability  distribution  over  the  set  of  all  pure  strategies.  A  behavioral 
strategy  for  i  is  an  overall  plan  for  local  randomization;  that  is,  a 
behavioral  strategy  consists  of  a  class  of  probability  distributions  such 
that  one  particular  distribution  is  assigned  to  the  set  of  moves  at  each  of 
his  information  sets.  Certain  combinations  of  "partial"  pure  strategies 
called  "signaling  strategies"  and  "associated"  behavioral  strategies  are 
called  "composite  strategies"  [32  :  pp.  267-289].  The  main  solution  concept 
for  games  in  extensive  form  is  the  Nash  equilibrium  point  which  is  a  col¬ 
lection  of  n  "optimal"  strategies  (one  for  each  player)  such  that  a 
unilateral  change  in  strategy  by  only  one  player  cannot  possibly  improve 
his  expected  payoff.  The  principal  problem  is  to  determine  such  equilibrium 
points  for  a  given  game. 

Host  of  the  major  results  about  extensive  games  are  of  a  theoretical 
nature.  These  theorems  guarantee  the  existence  of  optimal  strategies  which 
will  achieve  an  equilibrium.  In  1912  Zermelo  [88]  (see  vN-M  [81])  demon¬ 
strated  the  existence  of  an  optimal  pure  strategy  for  two-person  zero-sum 
games  with  perfect  information,  that  is,  games  such  as  checkers  or  chess, 
in  which  all  information  sets  contain  a  single  vertex.  Kuhn 
[ 28 ; 32  :  pp.  193-216]  extended  these  results  about  optimal  pure  strategies 
to  the  n-person  general-sum  games  with  perfect  information.  In  1928 


von  Neumann  [78  :  pp.  13-42]  showed  the  existence  of  optimal  mixed  strat- 
egies  for  any  two  peraou  zeio  nirm  game;  Llils  is  the  famous  Minimax  Theorem 
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or  Fundamental  Theorem  >£  Game  Theory.  Nash  [55,  56]  extended  the  equilibrium 
concept  beyond  the  two-person  zero-sum  games,  and  he  proved  that  there  are 
optimal  mixed  strategies  in  the  n-person  general-sum  case.  Kuhn  also  showed 
the  existence  of  optimal  behavioral  strategies  for  games  with  "perfect 
recall"  such  as  in  poker.  A  game  has  perfect  recall  if  each  player  is 
"aware"  at  each  of  his  moves  of  precisely  what  moves  he  picked  prior  to  it, 
but  may  not  know  all  the  choices  made  by  the  other  players.  Thompson 
[32  :  pp.  267-289)  proved  that  "composite"  strategies  suffice  to  obtain  an 
equilibrium  point  for  an  arbitrary  game,  and  he  illustrated  his  theory  for 
simplified  models  of  bridge. 

When  a  game  arises  in  applications,  one  frequently  begins  his  analysis 
by  describing  the  game  in  extensive  form.  This  gives  him  a  rather  complete 
picture  of  his  problem,  including  the  detailed  structure  or  rules  of  the 
game,  the  sequence  of  all  possible  moves,  the  state  of  each  player's  informa¬ 
tion,  and  the  payoffs.  Except  for  very  elementary  games,  however,  one  does 
not  normally  pursue  his  investigation  in  the  extensive  form.  This  is  because 
the  mathan-tlcnl  problem  of  actually  determining  optimal  strategies  for  this 
form  in  an  l  i r  '  :  .at  manner  has  not  been  resolved.  Instead,  one  reduces 
the  game  to  its  normal  form  (Section  A)  by  considering  the  full  list  of  pure 
strategic  lor  each  player  and  the  resulting  payoffs  when  these  strategies 
arc  <  np1  <■  _d.  In  th-..  ry  it  is  a  much  simpler  p  roblem  to  compute  optimal 
str  I'.gi  r  .  In  f’'»  no-rr.l  form.  For  examp’e,  in  the  case  of  the  two-person 
zero-sum  ioc  ,  it  is  '■"uivalent  to  solving  a  pair  of  dual  linear  programs. 

On  the  or'ir  hr.!,  in  practice  one  usually  gets  an  enormous  increase  in  the 
mr. her  ol  parn..i..t ers  necessary  to  describe  a  mixed  strategy  in  the  resulting 
non.nl  form  compared  to  the  number  of  variables  necessary  to  determine  a 
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behavioral  strategy  in  the  original  game  tree.  Fur  example,  Kuhn 
[29  :  pp.  101-105;  58  :  p.  99]  has  described  a  trivial  poker  game  in  which 
the  simplex  of  mixed  strategies  has  dimension  8191  while  the  "cube"  of 
behavioral  strategies  has  dimension  13.  This  astronomical  increase  in  the 
number  of  variables  to  be  determined  actually  occurs  in  some  important 
real-world  problems  and  often  forces  the  analyst  to  abandon  the  game 
theoretic  approach. 

Furthermore,  even  if  the  reduction  to  normal  form  results  in  a  problem 
which  is  computationally  feasible,  there  is  still  a  major  concern  about 
whether  this  approach  is  philosophically  sound.  It  is  true  that  for  games 
with  perfect  recall  an  optimal  mixed  strategy  induces  a  behavioral  strategy 
which  will  achieve  the  same  expected  payoff.  It  is  questionable,  however, 
whether  one  would  or  should  play  throughout  the  game  according  to  this 
latter  strategy.  The  subsequent  paper  by  Aumann  and  Maschler  illustrates 
some  pitfalls  in  the  passage  from  extensive  to  normal  form  and  it  questions 
some  other  fundamental  assertions  in  the  foundations  of  game  theory  —  at 
least  to  the  extent  that  they  are  commonly  understood. 

In  attempting  to  understand  and  simplify  the  theory  of  games  in  exten¬ 
sive  form,  some  early  workers  investigated  a  host  of  questions  about  useless 
information,  the  relation  between  information  partitions  and  the  set  of 
strategies,  notions  of  "equivalence"  of  games,  etc.  See,  for  example,  the 
paper  by  Dalkey  [32  :  pp.  217-243].  There  are  still  many  open  problems  in 
this  area. 

From  the  previous  three  paragraphs  it  is  clear  that  there  are  a  great 
number  of  unsolved  problems  in  the  theory  of  games  in  extensive  form.  Histor 
Lcally,  research  in  this  area  has  been  mostly  by-passed  in  recent  years  in 
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favor  of  work  on  the  other  forms.  It  Is  surely  important,  however,  to  resolve 
some  of  these  outstanding  and  neglected  problems,  and  the  time  may  now  be 
ripe  for  a  new  attack  on  them.  For  some  recent  work  along  these  lines  see 
Boudwin,  Rosenthal  and  Wilson  17,  85]. 

It  is  easy  to  extend  in  various  ways  the  concept  of  a  finite  game  tree 
to  the  infinite  case.  Gale  and  Stewart  [32  :  pp.  245-266]  have  shown  that 
certain  infinite  games  with  perfect  information  need  not  have  a  pure  strategy 
solution  if  one  assumes  the  axiom  of  choice.  This  has  given  rise  to  alternate 
assumptions  and  this  topic  has  been  applied  in  the  basic  foundations  of 
mathematics  (for  example,  see  Mycielski  [54]).  Infinite  games  have  also 
found  application  in  more  practical  problems  such  as  the  well  known  bomber 
battleship  duel  (see  Ferguson  [19]). 

4.  The  Normal  Form.  A  game  in  normal  form  is  simply  a  list  of  pure 
strategies  for  each  one  of  the  players  along  with  a  description  of  the 
resulting  payoffs  to  the  playars  for  any  possible  strategy  choices.  Let 
the  n  players  be  denoted  by  1,  2,  ...,  n,  and  let  player  i's  set  of 
pure  si  rate; ^es  be  Identified  with  the  nonempty  and  finite  set  of 
integers  ■  {1,  2,  . . . ,  n^}.  If  the  jayoffs  are  in  terms  of  real  numbers, 
then  a  finite  n-person  game  in  nor-r-al  form  or  a  poly.natrix  gnme  can  be 
desc-ibed  technically  as  a  payoff  function  F  from  the  cartesian  product 
N,  x  m  x  ...  x  ij  into  the  space  Rn  of  n-dimensional  vectors  with  real 
components.  If  each  player  i  picks  hts  pure  strategy  j^,  then  the  payoff 
to  player  k  is  F^(j ^ ,  j^,  ...»  jn>,  that  is,  the  kC^  component  of 
F(j^,  J2’  ®ne  can  *-nc^u^e  chance  events  in  the  game  by  adding  a 

set  Nq  iur  the  "chance  player."  There  is  a  single  given  probability 
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distribution  over  Ng,  and  one  then  works  with  expected  payoffs  in  the 
natural  way.  One  assumes  that  each  player  knows  the  complete  lists  of  strat¬ 
egies  and  the  resulting  payoffs  for  all  of  the  players,  and  that  each  one 
chooses  a  pure  strategy  simultaneously  or  in  ignorance  of  the  other's  choices. 
The  goal  of  each  player  is  to  maximize  his  expected  payoff.  Any  two-person 
game  can  be  described  by  a  matrix  with  a  pair  of  numbers  for  each  entry,  or 
by  a  pair  of  ordinary  matrices,  one  for  each  of  the  players.  These  are 
referred  to  as  the  bimatrix  games.  A  two-person  "zero-sum"  game  requires 
only  a  single  matrix  in  which  the  payoffs  are  to  the  "row"  player  and  are 
the  negative  of  those  to  the  "column"  player.  This  case  gives  rise  to  the 
well  known  theory  of  matrix  games.  Some  simple  examples  of  these  latter 
cases  are  given  in  the  paper  by  Aumann  and  Maschler.  Elementary  presenta¬ 
tions  of  the  theory  of  matrix  games  are  given  in  [20,  64,  79,  84].  This 
topic  is  covered  in  many  textbooks  at  various  levels;  for  example,  in 
[8,  15,  27,  51]. 

A  game  in  normal  form  is  a  special  case  of  a  game  in  extensive  form, 

and  again  the  main  solution  concept,  for  the  noncooperative  games  especially, 

is  the  Nash  equilibrium  point  or  some  specialization  of  this  concept.  As  in 

the  general  case,  not  all  games  in  normal  form  have  optimal  pure  strategies. 

Consult  Dresher  [17]  for  a  discussion  and  for  references  on  the  frequency  of 

pure  strategy  equilibria  in  "random"  games.  On  the  other  hand,  we  remarked 

in  the  previous  section  that  all  games  do  have  an  equilibrium  in  mixed 

strategies,  that  is,  probability  distributions  over  a  player's  pure  strate- 

i  ,  i  i 

gies.  If  each  player  i  picks  the  mixed  strategy  s  *  (s^  ,  s^ 
where  the  a*"  are  nonnegaftve  and  aim  to  one,  for  each  i,  then 
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expected  payoff  to  player  k  is 
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for  all  mixed  strategies  s  for  player  k  and  for  all  k  e  N.  In  fact  the 
existence  theorems  of  von  Neumann  and  Nash  are  usually  presented  in  the  normal 
form. 

Since  the  existence  of  equilibrium  points  is  guaranteed,  the  main  math¬ 
ematical  problem  consists  of  actually  determining  such  solutions  for  a 
particular  game.  As  mentioned  above,  in  the  case  of  the  two-person  zero-sum 
games  this  is  equivalent  to  solving  a  pair  of  dual  linear  programs.  This 
result  was  observed  by  von  Neumann  and  it  is  covered  in  a  great  number  of 
texts  and  papers,  for  example,  in  [11  :  Chapter  13]  and  [3].  Mills  [53]  shows 
that  solving  two-persor.  general-sum  games  is  equivalent  to  solving  a  special 
quadratic  programming  problem  or  an  integer  linear  programming  problem.  For 
algorithms  to  solve  this  particular  quadratic  program,  consult  Lemke  and 
Uowson  (34,  35]  and  Mangasarian  and  Stone  [42,  43].  Several  investigators  are 
currently  developing  algorithms  for  finding  solutions  for  the  multiperson 
games.  The  subsequent  paper  by  Howson  illustrates  the  work  in  this  area,  as 
do  some  other  recent  reports  by  Howson  [25],  Rosenmuller  [68],  and  Sobel  [75]. 
Furthermore,  Nash  showed  that  equilibrium  points  are  the  fixed  points  of  a 
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continuous  mapping,  and  thus  they  exist  as  a  consequence  of  certain  fixed 
point  theorems  and  they  may  be  approximated  by  recently  developed  algorithms 
which  converge  to  such  fixed  points  (see  Hansen  [23]  and  unpublished  work  by 
Shapley).  Dynamic  approaches  to  equilibrium  theory  using  systems  of  differ¬ 
ential  equations  have  been  investigated  by  Rosen  [66,  67]  and  Ponstein  [63]. 
For  a  more  complete  view  of  work  in  this  active  area  of  research  the  reader 
should  also  consult  the  several  additional  references  given  in  the  papers 
mentioned  above. 

There  are  of  course  many  extensions  and  generalizations  of  the  theory 
of  games  in  normal  form  as  presented  above.  A  player's  set  of  pure  strategies 
may  be  infinite,  discrete  and/or  continuous;  for  example,  the  set  of  all 
positive  integers,  an  interval  of  real  numbers  as  in  the  two-person  games 
"over  a  square,"  or  a  certain  class  of  curves  or  surfaces  in  space  as  arise 
in  the  theory  of  differential  games  (see  Isaacs  [26]).  Although  optimal 
strategies  do  not  always  exist  in  such  infinite  games,  there  are  a  large 
number  of  very  general  existence  theorems  about  the  corresponding  equilibria, 
as  illustrated  by  the  floorer,  of  Sion  [74]  and  of  Nikaldo  aid  Iscda  [37],  by 
several  paj  cr3  of  Ky  Fan,  anv.  in  the  new  hook  by  T.  Parihas.v  •  :hy  aud 
T.E.S.  Raghavan  [59],  There  is  also  a  fairly  extensive  literature  on 
multistage  or  sequentially  repeated  games.  An  introduction  to  this  area  is 
given  in  [41  :  Appendix  8]  and  [58  •  Chapter  5].  There  is  significant  inter¬ 
est  currently  in  the  basic  theory  of  repeated  games  of  incomplete  information, 
as  introduced  by  Harsanyi.  Mertens  and  Zamir  [52]  list  some  references  for 
work  on  the  two-person  zero-sum  games  and  Harsanyi  and  Selten  [24]  discuss 
the  two-person  bargaining  case.  Other  fundamental  changes  in  the  basic  defi¬ 
nitions  of  the  normal  form  can  be  made.  (any  of  the  theoretical  results  on 
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poiymatrix  garner  are  valid  for  types  of  payoffs  other  than  the  set  of  real 
numbers.  Walsh  [83]  has  introduced  a  two-person  theory  in  which  the  expected 
value  idea  is  replaced  by  the  use  of  a  median.  Marchi  (44]  has  investigated 
some  generalizations  of  the  equilibrium  point  concept. 

There  have  been  a  great  number  of  applications  of  the  noncooperative 
games  in  normal  form.  Even  a  very  superficial  survey  or  classification  of 
these  is  impossible  in  only  a  few  pages,  and  it  will  not  be  attempted  here. 
Since  the  two-person  zero-sum  case  is  fully  equivalent  to  the  theory  of  dual 
linear  programs,  it  is  theoretically  as  broad  in  its  applications.  Some 
problems  are  initially  formulated  more  naturally  in  one  theory  than  in  the 
other.  The  short  paper  by  Flood  presented  in  this  issue  is  an  interesting 
search  game.  Historically,  this  problem  arose  as  an  assignment  problem  with 
dimension  of  the  order  n!,  whir’  von  Neumann  in  turn  observed  could  be 
solved  as  a  much  smaller  hide  and  seek  game.  The  generalizations  of  the 
finite  theory  to  the  infinite  case  and  to  the  multistage  games  have  also 
found  many  applications  to  areas  such  as  in  the  theory  of  allocation  (games 
of  partitioning),  in  search  and  duel  theory  (games  of  timing),  as  well  as  in 
arms  control.  The  n-person  general-sura  theory  has  been  used  extensively, 
although  the  solution  concept  is  often  not  as  sharp  in  this  general  case. 

Some  difficulties  arise  when  a  game  has  nonunique  equilibrium  strategies  or 
when  these  give  rise  to  different  payoff  values  or  are  not  "interchangeable." 
There  are  times  when  one  may  prefer  or  should  be  advised  to  not  make  use  of 
an  optimal  mixed  strategy.  Nevertheless,  equilibrium  theory  is  an  important 
part  of  modern  theoretical  economics  as  is  illustrated  in  the  forthcoming 
volumes  Ly  Shapley  and  Shubik,  or  by  reviewing  the  papers  in  the  journal 
Econometrica.  For  example,  it  is  basic  in  bidding  theory  (see  Griesmer, 


Sbubik  and  I.evitan  [21,  22]).  The  infinite  normal  form  is  closely  related  to 
Abraham  Wald's  statistical  decision  theory  which  in  turn  embraces  mu-.i  -'i 
classical  statistics.  The  theory  of  the  normal  form  also  feeds  back  into 
pure  mathematics  where  it  has  lead  to  results  in  fixed  point  theory  and  separ¬ 
ation  properties  as  illustrated  by  some  work  of  Ky  Fan.  In  short  it  is  clear 
that  there  is  a  very  broadly  developed  theory  for  the  normal  form,  and  that 
this  part  of  game  theory  has  had  a  major  impact  on  the  way  the  analyst  views 
certain  problems;  it  has  become  a  frequently  used  tool  to  derive  actual  solu¬ 
tions  in  many  applied  areas  in  the  past  and  present;  and  it  has  contributed 
signif icantl>  to  several  other  theoretical  subjects. 

The  normal  form  of  a  game  is  also  employed  in  the  study  of  two-person 
general-sum  cooperative  games.  In  such  games  the  two  players  can  usually 
both  benefit  by  forming  a  coalition  and  taking  some  joint  action.  However, 
there  normally  remains  some  element  of  conflict  which  must  be  resolved,  and 
several  arbitration  schemes  and  bargaining  procedures  have  been  proposed  for 
this  purpose  [41  :  Chapter  6;  58  :  Chapter  7]. 

5.  The  Characteristic  Function  Form.  A  major  factor  in  the  multiperson 
cooperative  games  is  that  of  coalition  formation,  and  thus  the  maximum  amount 
attainable  by  any  potential  coalition  is  of  primary  concern.  Consequently, 
the  starting  point  for  most  studies  in  the  cooperative  n-person  games  when 
n  >  2  is  the  characteristic  function  formulation  suggested  by  von  Neumann 
[78  :  pp.  13-42]  in  1928  and  presented  in  detail  in  vN-M  [81].  An  n-person 
game  (N,v)  j.n  characteristic  function  form  consists  of  a  set  N  *  (1,  2,  ....  n 
of  n  players  denoted  by  1,  2,  ...,  n,  along  with  a  characteristic  function 
v  which  assigns  the  real  number  v(S)  to  each  nonempty  subset  S  of  players. 
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The  value  v(S)  measures  the  expected  worth  or  power  which  the  coalition  S 
can  achieve  when  its  members  act  together.  In  applications  the  values  v(S) 
for  the  various  coalitions  S  may  be  obvious  from  the  precise  statement  of 
a  game  problem,  or  it  may  be  derived  from  a  game  in  normal  form  by  taking, 
for  example,  an  "optimal  solution"  in  the  two-person  game  between  the  coali¬ 
tion  S  and  its  complementary  subset  N  -  S.  However,  much  of  the  detailed 
structure  of  the  game  in  normal  form  may  be  lost  in  this  reduction  to  char¬ 
acteristic  function  form,  and  certain  assumptions  about  the  player's  utilities 
are  necessary  in  order  to  make  use  of  the  results  of  the  latter  theory  in  the 
orif  •?.  no'-u.al  farm. 

The  miltiperoon  theories  frequently  use  the  characteristic  function  to 
define  a  set  A  of  n-dimensional  real  vectors  x  ■  (x^,  x^,  . ..,  xr)  which 
represent  the  re^lirabla  distributions  of  wealth  among  the  n  players;  player 
i  receives  the  an.  )"nt  xi  in  the  distribution  x.  In  most  models,  A  is 
called  the  sat  of  h  iput  k ions  and  consists  of  all  x  satisfying 

x.  +  x_  +  •  •  •  +  x  •  v(N) 

12  n 

and 

xi  >.  v ( { i } )  for  all  i  e  N. 

The  ro  .T.er  c  nditim  is  called  group  c^.tir-.ji  ity  or  Parat^  optimality,  and 
the  latter  i  cstri.n  Ion  is  referred  to  as  in  •  •"•d'.vl  rat ;  .nal  I 1  Intuitively, 
one  c a:>  think  of  v(N)  as  the  largest  amount  aval'. able;  the  p’ayers  will 
split  this  amount  with  no  player  taking  less  than  his  individual  value  v({i)). 
In  some  modi  lo  I  *  t on.'- 1  reeLa* ctionn  are  placed  on  the  funct  ion  v  such  as 
’’•t, ,«  H  t  r  i  -I ty’  ;  r  "mu. .  ton  .  ty"  and  stir,  smaller  or  larger  than  A  may  be 
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Introduced.  The  main  problem  then  is  to  determine  which  imputations  x  are 
more  likely  to  occur  as  final  outcomes  of  a  given  game.  There  are  many 
approaches  which  one  may  use  in  attempting  to  resolve  this  problem.  Hence, 
there  have  been  several  different  models  and  "solution  concepts"  proposed 
to  analyze  multiperson  cooperative  games  in  this  form.  In  each  such  model 
the  main  mathematical  problems  are  to  prove  whether  every  game  has  a  solution 
or  not,  to  describe  the  nature  or  properties  of  these  solution  sets,  and  if 
the  model  proves  to  be  applicable  to  find  algorithms  for  actually  determining 
a  solution  for  a  given  game.  In  applications  no  one  model  proves  to  be 
"valid"  or  completely  satisfactory  for  all  games,  nor  is  any  model  superior 
to  the  others  in  all  instances.  A  few  of  the  well-known  models  in  the 
cooperative  theory  are  discussed  most  briefly  in  the  following  paragraphs. 

More  detailed  descriptions  of  these  models  are  presented  in  a  nontechnical 
manner  in  [41  :  Chapters  8-12]  and  more  recently  by  Davis  [12]  and  Rapoport 
[65],  and  in  a  more  technical  form  by  Burger  [8  :  Chapter  4]  and  Owen 
[58  :  Chapters  8-10].  An  extensive  presentation  by  Shapley  and  Shubik  of 
this  area  and  its  economic  applications  is  in  progress.  Additional  references 
are  given  below  for  the  Interested  reader  who  desires  to  Investigate  some  of 
these  particular  models  in  more  detail. 

The  first  general  solution  concept  introduced  for  the  cooperative  games 
was  the  von  Neumann-Morgenstem  solution,  or  stable  set  [81].  They  defined 
on  the  set  A  a  preference  relation  called  dominance.  A  coalition  S  is 
effective  for  an  imputation  x,  or  x  is  S-ef fective ,  if  the  total  payoff 
in  x  to  the  players  of  S  is  not  more  than  their  value,  that  is,  if 

i  x.  <  v(S)  . 
icS 
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If  x  and  y  arc  in  A,  then  x  dominates  y  if  there  exists  a  nonempty 
subset  S  such  that  x  is  S  effective,  and  each  member  of  S  prefers  x 
to  y,  that  is,  if 

Xi  >  yi  f°r  i  e  S. 

A  subset  K  of  A  is  a  stable  set  if  no  x  in  K  dominates  any  y  in  K, 
and  if  every  imputation  z  not  in  K  is  dominated  by  some  x  in  K.  These 
conditions  are  called  internal  and  external  stability,  respectively;  and  they 
can  be  written  as 

K  D  Dom  K  =  0 


and 


K  U  Dom  K.  =  A 


where  0  is  the  empty  set  and  where 

Dora  K  =  {y  e  A:  x  dominates  y  for  some  x  e  K}. 

Early  research  on  stable  sets  indicated  that  they  might  exist  for  all  games. 
In  fact  many  games  have  a  great  number  of  stable  sets,  and  many  such  sets 
contain  infinitely  many  imputations.  On  the  other  hand,  developments  in 
recent  years  have  indicated  that  the  set  of  all  3table  sets  for  a  particular 
game  may  in  some  instances  be  rather  restricted,  and  several  counterexamples 
to  long-standing  conjectures  concerning  the  nature  of  stable  sets  have  been 
given.  These  developments  were  high-lighted  by  the  discovery  of  a  ten-person 
game  for  which  no  stable  set  exists  [37,  38].  The  author  [40]  has  just 
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completed  a  survey  of  the  mathematical  theory  of  multiperson  cooperative 
games  with  particular  emphasis  on  the  theory  of  stable  sets  and  the  core. 

In  addition  to  its  potential  applications,  there  is  some  interest  in  this 
concept  as  a  purely  mathematical  concept. 

One  of  the  simplest  solution  concepts  is  the  core.  The  theory  of  the 
core  is  implicit  in  the  theory  of  stable  sets  since  the  core  is  a  subset  of 
any  stable  set.  The  core  was  first  studied  explicitly  however,  in  the 
mid  1950's  by  Gillies  {78  :  pp.  47-85]  and  Shapley.  The  core  is  defined  as 

C  **  (x  e  A:  £  x,  >.  v(S)  for  all  nonempty  SCN}. 
icS  1 

No  coalition  S  can  protest  against  or  block  an  outcome  x  in  C  on 
grounds  that  the  coalition  can  expect  more.  The  outcomes  in  the  core  are 
neutral  in  the  sense  that  no  group  of  players  can  force  a  change.  If  v(N) 
is  "large  enough"  relative  to  the  other  values  v(S),  then  the  core  consists 
of  precisely  those  elements  which  are  "maximal"  in  A  with  respect  to  the 
relation  of  dominance.  The  nature  of  the  core  is  well  known  since  it  is  a 
polyhedral  set  and  it  can  be  studied  by  the  techniques  of  linear  programming 
or  by  the  theory  of  balanced  sets  [70].  However,  the  core  is  often  not  large 
enough  to  be  a  suitable  solution  concept.  C  may  be  the  empty  set;  for 
example,  in  any  "essential  constant-sum"  game.  Even  when  C  is  nonempty 
it  may  be  too  small,  as  in  "simple  games  with  veto  players"  where  it  fssJgns 
all  the  wealth  to  the  set  of  veto  players  even  though  they  may  not  be 
dictators,  that  is,  they  may  need  the  help  of  some  others  to  acMeve  these 
payoffs.  In  the  "treasure  hunt"  game,  in  which  any  two  cooperating  players 
can  carry  out  precisely  one  bar  of  gold,  C  is  «mpty  if  n  is  odd  and  C 
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is  nonempty  if  n  is  even.  (The  necessity  of  a  pair  in  order  to  obtain  a 
payoff  brings  to  mind  the  anecdote  on  page  34  in  the  Reader's  Digest  of 
January,  1971  in  which  the  workers  at  a  shoe  factory  near  viareggio  »-aly 
went  on  "strike"  by  producing  only  left-footed  shoes.)  In  any  event,  <  he 
core  normally  does  not  possess  the  property  of  external  stability.  There 
may  thus  be  outcomes  outside  of  the  core  which  are  not  dominated  by  any 
imputation  in  the  core. 

Several  authors  have  proposed  different  value  theories.  A  player's 
value  is  an  a  priori  measure  of  his  expected  gain  in  a  given  game.  Most 
value  theories  determine  a  unique  imputation  as  their  solution  concept.  This 
outcome  is  justified  by  arguments  based  upon  some  concept  of  fairness  as 
determined  by  certain  axioms,  upon  some  bargaining  procedure  or  arbitration 
scheme,  or  upon  probabilistic  considerations.  The  subsequent  paper  by  Owen 
gives  a  new  view  of  the  original  value  theory  by  Shapley.  Owen  suggests  ways 
the  Shapley  value  can  be  extended  or  generalized,  and  it  describes  a  method 
for  approximating  the  Shapley  value  for  large  games. 

Aumann  and  Iaachler  [78  :  pp.  443-476,  470-499,  501-512]  introduced 
several  similar  solution  concepts  called  bargaining  sets.  These  sets  describe 
what  payoffs  are  stable  once  a  given  coalition  structure  (partition  of  the 
player  set  N)  has  formed.  An  outcome  is  stable  if  there  is  no  "objection" 
to  it,  or  if  every  objection  to  it  gives  rise  to  a  "counter  objection." 

Roughly  speaking,  a  player  (or  coalition)  j  can  object  against  another  i 
in  the  same  coalition  S  when  a  payoff  vector  x  is  proposed,  if  he  can 
find  a  new  coalition  T  without  i  and  a  payoff  y  in  which  all  the  members 
of  T  get  more.  Player  i  can  then  counter  object  to  J's  objection  if 
he  can  find  a  coalition  U  without  j  and  an  outcome  z  in  which  all  the 
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members  of  U  get  their  original  amount  in  x  and  anyone  in  TfiU  gets  at 
least  what  he  would  get  in  the  objection  y.  An  individual  outcome  in  a 
bargaining  set  can  stand  on  its  own,  in  contrast  with  an  imputation  in  a 
vN-M  stable  set.  In  this  latter  theory  it  is  the  whole  set  which  possesses 
a  global  stability  or  represents  a  standard  of  behavior,  and  not  the  indivi¬ 
dual  imputations  in  a  solution.  Some  of  the  bargaining  sets  are  known  to 
contain  at  least  one  payoff  vector  for  each  partitioning  of  the  players  into 
a  coalition  structure,  and  the  general  matnematical  structure  of  these  sets 
is  known.  In  practice  it  is  difficult  to  describe  a  bargaining  set  for  a 
particular  game,  because  of  the  great  number  of  constraints  required  to 
consider  all  of  the  possible  objections  and  counter  objections.  For  addi¬ 
tional  material  on  the  classical  theory  of  bargaining  sets  the  reader  should 
consult  [46;  47;  45;  pp.  49-56,  161-169,  265-270:  and  73  :  pp.  39-52,  53-56], 
as  well  as  the  references  mentioned  below  for  the  kernel  and  nucleolus. 

Investigations  into  the  bargaining  set  theory  described  above  have  lead 
to  the  defining  of  additional  solution  concepts.  Davis  and  Maschler  [13] 
introduced  the  kernel  of  a  game  which  is  always  a  nonempty  subset  of  this 
bargaining  set.  For  more  details  see  [1,  48,  61,  76}  and  the  reference  lists 
in  these  papers.  Schmeidler  [69]  defined  the  nucleolus  which  turns  out  to  be 
a  unique  outcome  in  the  kernel,  and  it  is  in  the  core  if  the  latter  is 
nonempty.  The  nucleolus  is  the  imputation  which  successively  minimizes  the 
maximum  excess  (the  loudest  complaint)  defined  by 

e(x,S)  -  v(S)  -  l  x 
icS 
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over  all  coalitions  S.  For  those  imputations  at  which  the  maximal  excess 
is  minimal,  the  nucleolus  minimizes  the  next  largest  one,  and  so  forth.  Some 
properties  of  the  nucleolus  and  references  on  it  are  given  in 
(49,  5;  40  :  Section  7.2]. 

In  addition  to  those  mentioned  above,  several  other  solution  concepts 
have  been  proposed.  Some  of  these  are  reasonable  outcomes  [41  :  Sections 
11.1-11.3],  ^/-stability  (41  :  Chapter  10],  and  various  solutions  for  the 
games  in  partition  function  form  [33,  77).  The  competitive  equilibrium  from 
classical  economics  often  relates  to  some  of  the  solution  concepts  in  those 
games  for  which  it  is  well  defined.  There  are  many  natural  extensions, 
variations  and  generalizations  of  the  concepts  of  characteristic  function, 
imputation  space,  coalition  effectiveness  and  the  various  solution  concepts 
which  were  discussed  above  for  the  classical  model  of  games  in  characteristic 
function  form  and  in  which  side  payments  are  allowed.  One  major  model  is  the 
generalization  of  the  classical  theory  to  the  games  without  side  payments  in 
which  a  generalized  characteristic  function  describes  more  general  effective¬ 
ness  regions  than  the  half  spaces  used  above  and  in  which  a  more  general 
imputation  space  Is  employed.  For  a  survey  of  work  on  this  important  model 
soe  Aumann  [73  :  pp.  3-27]  and  Billera  [5].  There  are  several  extensions  of 
the  games  with  a  finite  number  of  players  to  those  with  infinitely  many 
players.  This  allows  for  the  use  of  the  tools  of  mathematical  analysis  such 
as  measure  theory,  and  the  results  may  hopefully  approximate  those  for  finite 
games  with  large  n  where  the  finite  techniques  for  analysis  have  often  been 
very  difficult.  There  is  considerable  research  in  progress  currently  on  the 
theory  of  games  with  a  continuum  of  players.  Aumann  and  Shapley  [2]  have  an 
extensive  work  on  the  theory  of  values,  and  several  reports  have  appeared 
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recently  on  the  theory  of  the  core.  Some  attempts  to  extend  the  various  con¬ 
cepts  In  bargaining  set  theory  to  games  without  side  payments  and  infinite 
games  have  so  far  not  been  as  successful  [6;  60;  62).  One  of  the  mos 
interesting  facts  about  some  of  the  infinite  models  is  that  many  solution 
concepts  which  are  distinct  for  finite  games  converge  to  the  same  set  as  the 
number  of  players  becomes  infinite.  A  few  attempts  have  been  made  in  both 
the  cooperative  and  noncooperative  cases  to  show  that  the  various  statically 
defined  solution  concepts  also  have  a  more  dynamic  stability,  that  is, 
beginning  with  an  arbitrary  imputation  there  is  a  tendency  to  move  to  an 
outcome  in  a  solution  set  (see  Billera  [6]).  Several  authors  art  beginning 
to  extend  the  theory  of  differential  games  from  two-person  to  multiperson 
situations  as  illustrated  in  Case  [9]  and  Vincent  and  Leitmenn  [80]. 

The  main  direction  in  application  of  the  theory  of  multiperson  coopera¬ 
tive  games  has  been  towards  the  social  and  behavioral  sciences.  The  game 
theory  model  is  the  most  natural  and  suitable  one  suggested  to  date  for 
structuring  theories  or  experiments  for  many  of  the  problems  that  arise  in 
these  areas,  at  least  to  the  extent  that  these  problems  can  be  quantified. 
Game  theory  has  been  useful  in  criticizing  previous  approaches,  both  con¬ 
structively  and  destructively,  and  it  has  provided  a  framework  for  additional 
investigations  of  both  a  theoretical  and  an  empirical  nature.  Most  of  the 
known  solution  concepts  have  found  application  to  economics.  The  formulation 
of  economic  problems  as  games  has  clarified  many  points,  and  frequently  the 
various  game  solutions  have  then  added  new  insights.  The  extent  of  these 
developments  will  be  clear  when  the  forthcoming  volumes  by  Shapley  and  Shubik 
are  finally  realized.  In  particular,  the  recent  developments  in  the  theory 
of  games  with  a  continuum  of  players  may  have  major  impact  in  economics  — 
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perhaps  even  comparable  to  that  of  probability  theory  —  if  certain  basic 
problems  in  the  foundations  and  of  a  mathematical  nature  can  be  resolved. 
Although  games  have  not  yet  been  used  much  for  the  actual  prediction  of 
real-world  outcomes,  and  although  they  so  far  have  lacked  certain  dynamic 
features,  they  are  nevertheless  proving  important  in  economic  theory.  Many 
of  the  non  superficial  aspects  of  the  game  approach  have  received  consider¬ 
able  attention  in  the  past  few  years  and  it  is  very  likely  that  we  are 
witnessing  its  rebirth  in  mathematical  economics.  In  political  science, 
the  multiperson  theory  is  used  to  investigate  voting  situations  and  the 
Shapley  value  serves  as  a  power  index.  This  application  is  mentioned  in 
Owen's  paper.  For  additional  discussions  in  this  area  see  [4;  18;  72  : 

Part  III].  The  multiperson  theory  also  provides  models  for  certain  ecologi¬ 
cal  problems  [71]. 

In  many  applications  of  the  cooperative  theory  the  results  seem  rather 
vague,  because  there  are  several  different  solution  concepts  and  some  of 
these  are  not  as  sharp  or  precise  as  the  answers  given  by  many  other 
approaches;  for  example,  the  unique  solution  in  a  two-person  zero-sum  game. 
Rather  than  being  a  weakness,  however,  this  multiplicity  of  solutions  is  for 
the  most  part  inherent  to  the  problems,  and  shows  the  richness  of  the  theory 
due  to  the  diversity  of  possible  human  behavior  in  a  multipolar  world  in 
which  concepts  like  "fairness"  and  "most  preferred"  mean  different  things  to 
different  people.  It  is  very  unlikely  that  all  groups  of  people  will  accept 
any  one  well-defined  solution  concept  as  being  universally  applicable.  As 
for  the  inability  of  the  analyst  to  actually  evaluate  some  of  the  various 
known  solution  concepts  for  particular  games,  this  is  due  to  the  inherent 
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mathematical  difficulties  in  the  .ode.  On  the  other  hand,  idle  i=  — 
a  more  active  area  of  research  and  fete  have  been  significant  -elopments 
along  these  lines  in  recent  years,  hany  of  these  difficulties  are  lihely 
to  he  resolved  if  the  theory  receives  as  much  attention  as  have  other  areas 
of  comparable  Importance  in  applied  mathematics.  In  summary,  fere  have 
been  significant  and  promising  developments  in  the  cooperative  theory  and 
its  applications  and  prospects  for  its  future  appear  bright. 
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